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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 06/14/2007 has been entered. 

2. This communication is responsive to Amendment, filed 06/14/2007. 

Claims 1-2, 4, 6-14, 16, 18-23 are pending in this application. Claims 1, 4, 6, 14, 16, 18, 
21, 25 have been amended, and claims 1, 4, 6, 14, 16, 18, 21, 25 have been cancelled. This 
action is made non-Final. 



Claim Rejections - 35 USC § 103 
3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1 .56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 
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4. Claims 1, 2, 4, 6-14, 16, 18-23, 25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yamaguchi (US Patent No. 7,006,671)), in view of Toyama et al. (US Patent 
No. 7,068,309), and Lee (US Patent No. 6,947,578), and further in view of Hacker (US Patent 
No. 6,988,075). 

As to claims 1, 14, Yamaguchi teaches a method of capturing, analyzing, managing, and 
accessing disparate types and sources of media, biometric, and database information, the method 
comprising (col. 2, line 20 to col. 3, line 33; Figs. 2, 3A, 3B): 

capturing media, biometric, and database information association with an individual (i. e. 
information related to a bodily feature such as a fingerprint, voiceprint, hair, or nail can also be 
used as specific information, or a physical key such as an IC card can also be used as specific 
information. Security can be improved using a plurality of pieces of specific information, col. 3, 
line 63 to col. 4, line 4); 

including time information with the captured media, biometric, and database information 
associated with an individual to create a multi-modal chronological dossier of the individual, 
wherein the time information includes when the media, biometric, and database information is 
captured (i. e. for each registered person, pieces of information including the captured image or 
extracted feature as the specific information of the registered person, the dictionary, the name of 
the registered person, the registration number, the registration date when these pieces of 
information are stored in the storage device 11, and the use situation such as the date/time and 
place of identification of the registered person, col. 5, lines 31-54); 

processing the media, biometric, and database information to extract, analyze and sort 
through digital information associated with a number of individuals (i.e. extract specific 
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information of an object person from the object person , col. 2, lines 3-45; the sorting method, 
col. 5, line 61 to col 6, line 3); 

providing a user interface (i. e. The administrator can easily obtain necessary information 
at a necessary time, col. 5, lines 31-54) that can be configured to retrieve, view, manage, 
compare, and analysis (i.e. classifies; comparing, sorts, col. 2, lines 3-45). 

Yamaguchi does not specifically teach annotate the captured information. 

Toyama teaches annotate the captured information (col. 3, lines 38-50; col. 4, lines 49- 

67). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi and Toyama at the time the invention was made to modify the system of Yamaguchi 
to include annotate the captured information as taught by Toyama. 

One of ordinary skill in the art would be motivated to make this combination in order to 
allow users to effectively search and control access to the photo index or photo database in view 
of Toyama, as doing so would give the added benefit of easily sharing images with a specific 
small group of people, a larger group of people, or the whole world as taught by Toyama (col. 3, 
lines 25-37). 

Yamaguchi and Toyama do not teach selectively presenting a summary profile in the user 
interface, wherein the summary profile comprises a plurality of images of the individual captured 
at different times. 

Lee teaches selectively presenting a summary profile in the user interface, wherein the 
summary profile comprises a plurality of images of the individual captured at different times 

(See Fig. 8 A). 
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It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi, Toyama, and Lee at the time the invention was made to modify the system of 
Yamaguchi and Toyama to include the limitations as taught by Lee. 

One of ordinary skill in the art would be motivated to make this combination in order to 
provide a system for capturing in substantially concurrent manner a plurality of images of a 
given subject in acquiring a predetermined set of identification data (Summary) in view of Lee, 
as doing so would give the added benefit of performing a system for quickly and conveniently 
acquiring various aspects of identification data pertaining to a subject (Summary) as taught by 
Lee. 

Yamaguchi, Toyama, and Lee does not expressly teach the multi-modal chronological 
dossier of the individual. 

Hacker teaches the multi-modal chronological dossier of the individual (See Fig. 2; 
chronological table of contents (TOC), or from other categorized sections 220 such as by doctor, 
by diagnostic test, by prescription, etc. The browser window can also provide a menu 230 for 
selecting other tools for viewing data from the patient's record, col. 8, lines 46-67). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi, Toyama, Lee, and Hacker at the time the invention was made to modify the system 
of Yamaguchi, Toyama, Lee to include the limitations as taught by Hacker. 

One of ordinary skill in the art would be motivated to make this combination in order to 
obtain hypertext that links to the records can be chosen from a chronological table of contents 
(col. 8, lines 46-67) in view of Hacker, as doing so would give the added benefit of achieving a 
system and service for centrally storing patients medical records electronically on a database for 
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patient-controlled remote access by both patients and medical providers over a public network 
(col. 6, lines 14-18) as taught by Hacker. 

As per claim 21, Yamaguchi teaches a processing system comprising: 
a central processing unit (CPU) (Fig. 1, col. 10, lines 16-19); and 

a storage device coupled to the CPU and having stored there information for configuring 
the CPU to: 

capture media, biometric, and database information associated with an individual 
(i.e. information related to a bodily feature such as a fingerprint, voiceprint, hair, or nail can 
also be used as specific information, or a physical key such as an IC card can also be used as 
specific information. Security can be improved using a plurality of pieces of specific information, 
col. 3, line 63 to col. 4, line 4); 

assign timing information (i.e. timepiece 18, Fig. 1) to the captured media, 
biometric, and database information associated with the individual to form a history of captured 
information including times of when the media, biometric and database information is captured 
(i.e. for each registered person, pieces of information including the captured image or extracted 
feature as the specific information of the registered person, the dictionary, the name of the 
registered person, the registration number, the registration date when these pieces of 
information are stored in the storage device 11, and the use situation such as the date/time and 
place of identification of the registered person; "images of persons who used the personal 
identification apparatus from X to Y o'clock", col. 5, lines 31-54); 
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processing the media, biometric, and database information to extract, analyze and 
sort through digital information associated with a number of individuals (i.e. extract specific 
information of an object person from the object person , col. 2, lines 3-45; the sorting method, 
col. 5, line 61 to col. 6, line 3); 

providing a user interface (i.e. The administrator can easily obtain necessary 
information at a necessary time, col. 5, lines 31-54) that can be configured to retrieve, view, 
manage, compare, and analysis (i.e. classifies; comparing, sorts, col. 2, lines 3-45). 
Yamaguchi does not teach annotate the captured information. 

Toyama teaches annotate the captured information (col. 3, lines 38-50; col. 4, lines 49- 

67). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi and Toyama at the time the invention was made to modify the system of Yamaguchi 
to include annotate the captured information as taught by Toyama. 

One of ordinary skill in the art would be motivated to make this combination in order to 
allow users to effectively search and control access to the photo index or photo database in view 
of Toyama, as doing so would give the added benefit of easily sharing images with a specific 
small group of people, a larger group of people, or the whole world as taught by Toyama (col. 3, 
lines 25-37). 

Yamaguchi and Toyama do not specifically teach selectively presenting a summary 
profile in the user interface, wherein the summary profile comprises a plurality of images of the 
individual captured at different times. 
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Lee teaches selectively presenting a summary profile in the user interface, wherein the 
summary profile comprises a plurality of images of the individual captured at different times 
(See Fig. 8A). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi, Toyama, and Lee at the time the invention was made to modify the system of 
Yamaguchi and Toyama to include the limitations as taught by Lee. 

One of ordinary skill in the art would be motivated to make this combination in order to 
provide a system for capturing in substantially concurrent manner a plurality of images of a 
given subject in acquiring a predetermined set of identification data (Summary) in view of Lee, 
as doing so would give the added benefit of performing a system for quickly and conveniently 
acquiring various aspects of identification data pertaining to a subject (Summary) as taught by 
Lee. 

Yamaguchi, Toyama, and Lee do not expressly teach the multi-modal chronological 
dossier of the individual. 

Hacker teaches the multi-modal chronological dossier of the individual (See Fig. 2; 
chronological table of contents (TOC), or from other categorized sections 220 such as by doctor, 
by diagnostic test, by prescription, etc. The browser window can also provide a menu 230 for 
selecting other tools for viewing data from the patient's record, col. 8, lines 46-67). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Yamaguchi, Toyama, Lee, and Hacker at the time the invention was made to modify the system 
of Yamaguchi, Toyama, Lee to include the limitations as taught by Hacker. 
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One of ordinary skill in the art would be motivated to make this combination in order to 
obtain hypertext that links to the records can be chosen from a chronological table of contents 
(col. 8, lines 46-67) in view of Hacker, as doing so would give the added benefit of a system and 
service for centrally storing patients medical records electronically on a database for patient- 
controlled remote access by both patients and medical providers over a public network (col. 6, 
lines 14-18) as taught by Hacker. 

As per claim 2, Yamaguchi teaches the media, biometric, and database information 
includes a facial image, voice audio, or fingerprint (col. 3, line 63 to col. 4, line 4). 

As to claims 4, 16, Lee teaches the summary profile further comprises an abstract 
including intelligent portions of various captures of media, biometric, and database associated 
with the individual (See Fig. 8A). 

As to claims 6, 18, Yamaguchi teaches the selective presentation of the summary profile 
in the user interface is in response to a search query (col. 5, lines 31-54; col. 9, lines 45-53). 

As to claims 7, 19, Yamaguchi teaches providing for a user-defined search of digital 
information associated with a number of individuals (col. 5, lines 31-54). 
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As to claims 8, 20, Yamaguchi teaches conducting a more like this search when a search 
result from the user-defined search of digital information associated with a number of individuals 
is explored (col. 5, lines 31-54). 

As per claim 9, Yamaguchi teaches the more like this search uses facial, and other 
biometric information to find matches (col. 5, lines 31-54). 

Hacker teaches the more like this search uses speech, and other biometric information to 
find matches (i.e. Although the system can use any suitable means for providing a unique access 
identification means for each patient, including assigned alpha-numeric passphrases, smart 
cards, and biometric samples (voiceprint, fingerprint, retina scan, DNA-ink, etc.), a preferred 
embodiment that will be used for this description is a card (or bracelet for hospitalized patients) 
with a unique bar code for each patient, col. 7, lines 43-50). 

As per claim 10, Yamaguchi teaches capturing media, biometric, and database 
information associated with an individual includes using a video camera to capture audio and 
moving pictures of the individual (col. 4, lines 5-67). 

As per claim 11, Yamaguchi teaches processing the media, biometric, and database 
information to extract, analyze and sort through digital information associated with a number of 
individuals includes analyzing the media, biometric, and database information with respect to 
identification factors (col. 2, line 20 to col. 3, line 33; Figs. 2, 3A, 3B). 
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As per claim 12, Yamaguchi teaches processing the media, biometric, and database 
information to extract, analyze and sort through digital information associated with a number of 
individuals includes comparing captured media, biometric, and database information of a first 
individual with media, biometric, and database information of a number of categorized 
individuals to find a best match (col. 2, line 20 to col. 3, line 33; Figs. 2, 3 A, 3B). 

As per claim 13, Yamaguchi teaches displaying video thumbnails of video images of the 
number of individuals on the user interface (Fig. 6). 

As per claim 22, Yamaguchi teaches a presentation device wherein the presentation 
device is configured to provide a graphical user interface which presents representations of the 
captured media, biometric, and database information associated with the individual {col. 5, lines 
31-54). 

As per claim 23, Toyama teaches an interface device configured to connect the CPU 
with a network of computers (col. 3, lines 25-37). 

As per claim 25, Lee teaches the summary profile further comprises an abstract 
including intelligent portions of various captures of media, biometric, and database information 
associated with the individual (See Fig. 8A). 
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Response to Arguments 
5. Applicant's arguments concerning the prior arts do not suggest or teach the newly 
amended claims with respect to claims 1 , 14, 21 have been considered but are moot in view of 
the new ground(s) of rejection. 



Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Miranda Le whose telephone number is (571) 272-41 12. The 
examiner can normally be reached on Monday through Friday from 8:30 AM to 5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John R. Cottingham, can be reached on (571) 272-7079. The fax number to this Art 
Unit is 571-273-8300. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (703) 305-3900. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov . Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

Miranda Le 
August 28, 2007 



